Learning ECOC and Dichotomizers Jointly from Data
نویسندگان
چکیده
In this paper, we present a first study which learns the ECOC matrix as well as dichotomizers simultaneously from data; these two steps are usually conducted independently in previous methods. We formulate our learning model as a sequence of concave-convex programming problems and develop an efficient alternative minimization algorithm to solve it. Extensive experiments over eight real data sets and one image analysis problem demonstrate the advantage of our model over other state-of-theart ECOC methods in multi-class classification.
منابع مشابه
Combining Linear Dichomotizers to Construct Nonlinear Polychotomizers Combining Linear Dichomotizers to Construct Nonlinear Polychotomizers
A polychotomizer which assigns the input to one of K; K 3, is constructed using a set of dichotomizers which assign the input to one of two classes. We propose techniques to construct a set of linear dichotomizers whose combined decision forms a nonlinear polychotomizer, to extract structure from data. One way is using error-correcting output codes (ECOC). We propose to incorporate soft weight ...
متن کاملAn experimental analysis of the dependence among codeword bit errors in ECOC learning machines
One of the main factors affecting the effectiveness of Error Correcting Output Coding (ECOC) methods for classification is the dependence among the errors of the computed codeword bits. We present an extensive experimental work for evaluating the dependence among output errors of the decomposition unit in ECOC learning machines. In particular, we apply measures based on mutual information to co...
متن کاملMartigny - Valais - Suisse Combining Linear
A polychotomizer which assigns the input to one ofK K is constructed using a set of dichotomizers which assign the input to one of two classes We propose techniques to construct a set of linear dichotomizers whose combined decision forms a nonlinear polychotomizer to extract structure from data One way is using error correcting output codes ECOC We propose to incorporate soft weight sharing in ...
متن کاملDependence among Codeword Bits Errors in ECOC Learning Machines: An Experimental Analysis
One of the main factors affecting the effectiveness of ECOC methods for classification is the dependence among the errors of the computed codeword bits. We present an extensive experimental work for evaluating the dependence among output errors of the decomposition unit of ECOC learning machines. In particular, we compare the dependence between ECOC Multi Layer Perceptrons (ECOC monolithic), ma...
متن کاملError-correcting output codes based ensemble feature extraction
This paper proposes a novel feature extraction method based on ensemble learning. Using the errorcorrecting output codes (ECOC) to design binary classifiers (dichotomizers) for separating subsets of classes, the outputs of the dichotomizers are linear or nonlinear features that provide powerful separability in a new space. In this space, the vector quantization based meta classifier can be view...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2010